<!doctype html>
<html lang="en">

<head>

    <meta charset="utf-8">
    <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">

    <link rel="stylesheet" href="/packages/assets/bootstrap/bootstrap.min.css">

    <title>Alternatives</title>

    <link rel="stylesheet" href="/packages/assets/css/style.css">
    <script src="/packages/assets/js/code.js"></script>
    
<meta name="twitter:card" content="summary"/>
<meta name="twitter:image" content="https://eclipse.org/packages/images/icon/twitter_icon.png"/>
<meta name="twitter:title" content="Telemetry end-to-end | Alternatives"/>
<meta name="twitter:description" content="Thinking about alternatives."/>


    <link rel="icon" type="image/svg+xml" href="/packages/images/icon/icon.svg" sizes="any">
    <link rel="icon" href="/packages/images/icon/icon.png" sizes="192x192">
    <link rel="apple-touch-icon-precomposed" href="/packages/images/icon/icon_apple.png" sizes="180x180">

</head>

<body>

    <header>
<nav class="navbar navbar-expand-md fixed-top navbar-light bg-light">
  <div class="container">
    <a class="navbar-brand" href="/packages/">
      <img src="/packages/images/icon_brand_navbar.svg" width="30" height="30" alt="Eclipse IoT Packages™">
    </a>
    <button class="navbar-toggler" type="button" data-toggle="collapse" data-target="#navbarCollapse" aria-controls="navbarCollapse" aria-expanded="false" aria-label="Toggle navigation">
      <span class="navbar-toggler-icon"></span>
    </button>
    <div class="collapse navbar-collapse" id="navbarCollapse">
      <ul class="navbar-nav mr-auto"><li class="nav-item">
          <a
              class="nav-link"
              href="/packages/">Home</a>
        </li>
        <li class="nav-item">
          <a
              class="nav-link"
              href="/packages/about/">About</a>
        </li>
        <li class="nav-item">
          <a
              class="nav-link"
              href="/packages/faq/">FAQ</a>
        </li>
        <li class="nav-item">
          <a
              class="nav-link"
              href="/packages/contribute/">Contribute</a>
        </li>
        <li class="nav-item">
          <a
              class="nav-link"
              href="/packages/prereqs/">Prerequisites</a>
        </li>
        <li class="nav-item">
          <a
              class="nav-link"
              href="/packages/repository/">Repository</a>
        </li>
        </ul>
    </div>
  </div>
</nav></header>

    <main id="main" role="main" >
      

<div><div class="container mt-5">
  <div class="row">
  <div class="col-12 col-sm-9 col-xl-8">
  <h1>Telemetry end-to-end</h1>
<p class="lead">A package showing telemetry data acquisition end-to-end: Microcontroller firmware to cloud side data processing, using Drogue IoT and Apache Kafka in the process.</p></div>
  
  <div class="col-12 col-sm-3 col-xl-4 d-flex flex-sm-row-reverse">
      <img alt="Page logo"  src="/packages/packages/telemetry-e2e/images/telemetry-e2e-logo.svg" class="img-fluid m-lg-3 d-block align-self-center " style="max-height: 10rem;"/>
  </div>
  </div>
</div>
</div>

<div class="container">

<nav class="nav nav-pills nav-fill mt-2 mb-5"><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/">Overview</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/10-installation-cloud/">Cloud</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/20-installation-gateway/">Gateway</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/30-installation-device/">Device</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/40-using/">Using it</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/50-understand/">Understanding it</a><a class="nav-item nav-link  active" href="/packages/packages/telemetry-e2e/60-alternatives/">Alternatives</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/70-cheating/">Cheating</a><a class="nav-item nav-link " href="/packages/packages/telemetry-e2e/90-learn/">Learn more</a></nav>
<div class="row">

<div class="col-12 col-md-8 col-lg-9">

    <p>One thing to keep in mind is, that this is a demo to show an end-to-end integration of open source IoT with
Eclipse IoT projects. And it is intended to manage much more than a single device, with a single value. This is
a scalable cloud platform, which is targeted towards more complex use cases. To make it simpler for you, we are
focusing on a very basic use case. Which you can extend, if you like.</p>

    <h2 id="architecture">Architecture</h2>

    <p>But let’s take a look at some of the components and think about alternatives.</p>

    <h3 id="the-sensor">The sensor</h3>

    <p>Bluetooth is used because it is a versatile, but still a low power wireless communication mechanism. You could easily
run this microcontroller on batteries for quite a while.</p>

    <p>Using WiFi would increase the power consumption, but allow you to directly communication with the cloud.</p>

    <p>LoRaWAN for example would allow for even more power savings, but reduce
the amount and frequency of the telemetry updates. For this example, it would also be challenging to self-host all
the LoRaWAN components.</p>

    <h3 id="digital-twin">Digital twin</h3>

    <p>Do you really need a digital twin platform? Well, at some point your application needs to structure the data and
understand the structure. History has shown that structuring the data can be a problem, but in most cases isn’t a big
one. Aligning on the same structure however is. Not only do data formats changes over time, but also do different
devices and vendors come with different formats. Using a digital twin platform, allows you to normalize the data,
and structure it in the way it is best for your use case.</p>

    <p>And once you did that, you suddenly notice that you can work quite differently with your data. Especially if you have
the capabilities that Ditto offers, like listening for state changes, or reconciling actual vs desired state.</p>

    <p>Sure you can “manually” do this in a small application. But with that, you just re-create parts of a digital twin
platform. Any in most cases, over and over again.</p>

    <h3 id="mqtt-between-ditto-and-streamsheets">MQTT between Ditto and Streamsheets</h3>

    <p>Instead of using the Streamsheets internal MQTT broker, it would also be possible to use Kafka again as the way deliver
changes from Ditto to Streamsheets, as both projects support Kafka too.</p>

    <p>As Streamsheets is the only consumer of the data in this example, we kept the internal MQTT broker of Streamsheets.
Simply because it is Mosquitto, which too is an Eclipse IoT project.</p>

    <h3 id="visualization">Visualization</h3>

    <p>Of course, what also comes in one’s mind is Grafana. First of all, most people already know it by now. Second, it is better suited
for time services data. And in this example, we are focusing more on structured telemetry data. True, a single
temperature value isn’t that complex. However, you have all the code and tools available to extend this.</p>

    <h2 id="what-else">What else?</h2>

    <p>There are a few more projects and alternatives we could have used. Maybe you can add them?!</p>

    <h3 id="eclipse-kapua">Eclipse Kapua</h3>

    <p>We deployed the Kura gateway directly using a container. If you read on, there is a reason for that.</p>

    <p>However, you could also install Kura directly on your gateway hardware, and have it managed by
<a href="https://eclipse.org/kapua/">Eclipse Kapua</a>.</p>

    <h3 id="eclipse-iofog">Eclipse ioFog</h3>

    <p>ioFog is an edge orchestration platform. Instead of manually running a Kura container, we could use it do manage
Kura as an edge workload.</p>

    <p>We hope we can add ioFog, once version 3.0 is released. We do require some new tweaks, which will only be available
in the newer version.</p>

    <h3 id="time-series-database">Time series database</h3>

    <p>In order to build up a history of all measured and reported temperature values and make this history accessible in an
optimized way for asking advanced queries (e.g. using filtering, aggregation, grouping and downsampling), a time series
database is the obvious choice to store data in an optimized way.</p>

    <p>You can create another connection in Ditto, additionally to the MQTT connection which sends data to Streamsheets.
But this time, using an HTTP outbound connection. As Ditto supports formatting the outbound data with a JavaScript
snippet too, it is easy to generate a <a href="https://cloudevents.io/">CloudEvent</a> from the Ditto change event.</p>

    <p>Directing the CloudEvent towards a <a href="https://knative.dev">Knative</a> service, changes can be pushed directly into a
<a href="https://www.timescale.com/">TimescaleDB</a> instance, using the <a href="https://github.com/drogue-iot/drogue-postgresql-pusher">serverless function for pushing to PostgreSQL</a> (of course you can also push to other time series database with that approach,
or even to other serverless functions or services, which accept CloudEvents).</p>

    <p>Finishing up by creating a nice dashboard with <a href="https://grafana.com/">Grafana</a>, based on this data.</p>

  </div>

<div class="col-12 col-md-4 col-lg-3 

">

    <div class="position-sticky" style="top: 4rem;">


<aside>
<div class="card">
<div class="card-body">
<h5 class="card-title">Table of contents</h5>
<div id="toc" class="toc"></div>
</div>
</div>
</aside>

<script>generateToc("#toc", "h2[id], h3[id], h4[id]");</script>


</div>

  </div>

</div>

</div>

    </main>

    <footer class="page-footer">

    <div class="container">

    <div class="row">

    

        

            <div class="col-6 col-md">
            
            
                <h5>Eclipse IoT Packages</h5>
                <ul class="list-unstyled">
                    
                        <li>
                            <a class="text-muted" href="/packages/">Home</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="/packages/about">About</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="/packages/contribute">Contribute</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://eclipse.org/security">Security</a>
                        </li>
                    
                </ul>
            
            </div>
        

            <div class="col-6 col-md">
            
            
                <h5>Eclipse IoT</h5>
                <ul class="list-unstyled">
                    
                        <li>
                            <a class="text-muted" href="https://iot.eclipse.org">Top Level Project</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/org/workinggroups/iotwg_charter.php">Working group</a>
                        </li>
                    
                </ul>
            
            </div>
        

            <div class="col-6 col-md">
            
            
                <h5>Legal</h5>
                <ul class="list-unstyled">
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/legal/privacy.php">Privacy Policy</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/legal/termsofuse.php">Terms of Use</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/legal/copyright.php">Copyright Agent</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/legal/epl-2.0/">Eclipse Public License</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/legal">Legal Resources</a>
                        </li>
                    
                </ul>
            
            </div>
        

            <div class="col-6 col-md">
            
            
                <h5>Eclipse Foundation</h5>
                <ul class="list-unstyled">
                    
                        <li>
                            <a class="text-muted" href="https://eclipse.org/org">About us</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/org/foundation/contact.php">Contact us</a>
                        </li>
                    
                        <li>
                            <a class="text-muted" href="https://www.eclipse.org/org/foundation/directors.php">Board of Directors</a>
                        </li>
                    
                </ul>
            
            </div>
        

    
    </div>

    
    <div class="row">
        <div class="col-12 col-md text-muted">Copyright © Eclipse Foundation, Inc. All Rights Reserved.</div>
    </div>
    

    </div>

</footer>


    <script src="/packages/assets/popper.min.js"></script>
    <script src="/packages/assets/jquery.min.js"></script>
    <script src="/packages/assets/bootstrap/bootstrap.min.js"></script>

    <script src="/packages/assets/clipboard.min.js"></script>
    <script src="/packages/assets/clipboard.js"></script>

</body>

</html>